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Information sources can be classified into two catego- 
ries based on the nature of their outputs, namely analog 
information and discrete information sources. Analog infor- 
mation sources such as a microphone actuated by speech, or a 
TV camera scanning a scene, emit one or more continuous 
amplitude signals. These analog information sources can be 
transformed into discrete information sources (througiaeas 
process of sampling and quantizing in order to allow trans- 
mission through a digital communication channel. Discrete 
information sources such as a teletype machine or a computer 
producing an alphanumeric output generate a sequence of 
discrete source symbols and therefore need no further digi- 
EEZi no. 

The discrete outputs of the information sources are 
converted through a source encoder into a binary sequence of 
O's and 1's by assigning codewords to the symbols in its 
input sequence. The modulator in the system then accepts 
these bit streams as its input and converts the bits stream 
into electrical waveforms suitable for transmission over the 
communication channel. The modulator can assign waveforms to 
a group of bits of arbitrary size. For example, ina 4=-bit 
group size, the modulator needs to assign sixteen distinct 
waveforms to represent the sixteen different combinations of 
4-binary bits and this is known as a 16=-state modulation. In 
general, non-binary modulation techniques are simply 
referred to as M-ary modulation. 

At present, binary and 4-ary modulation techniques are 
the more common methods utilized and implemented. However, 
with the crowded conditions prevailing in many regions of 
the radio spectrum and the emphasis on modern digital satel- 


lite transmission techniques, there is a need for achieving 


Ke 


improved spectrum utilization. The higher order M-ary (M=8 
and above) modulation techniques which tend to be spectrally 
more efficient than the binary or 4-ary modulations at the 
expense of signal-to-noise ratio and are now employed more 
frequently. With new developments in the more efficient 
high-power microwave amplifier designs and advancements in 
solid-state technology, it is probable that future genera- 
tions of communication system will be able to operate at low 
signal-to-noise ratios so as to enable the use of the more 
spectrally efficient modulation techniques. 

Since digital information transmission is based on 
Carriers modulated by the symbol waveforms, the symbol error 
probabilities can often be computed directly. As a result, 
the derivation of symbol error probabilities can be found in 
many references (see [Ref. 1: pp. 228-234, Ref. 2: pp. 
204-207] for examples). However, from the viewpoint of a 
binary digital communication system, the bit error rate is 
often a better performance criteria and offers a more 
uniform measure when comparing performances of systems with 
different levels of modulation. As the bit error probabili- 
ties for Meary modulation systems are not found in refer- 
ences, the first part of this thesis was devoted to 
developing a general receiver structure for M-ary PSK modu- 
lation and deriving a general relation between bit and 
symbol error probabilities. Receivers for direct bit detec- 
tion applicable to 8-ary and l6-ary PSK modulations were 
proposed next, and the bit error’rate computed and compared 
to that of a standard phase detection receiver assuming 
Signal reception over an additive white Gaussian noise 
(AWGN) channel. It is shown that receiver employing direct 
bit detection offers simpler hardware implementation and yet 
provide bit error rate comparable to that of the standard 


phase detection receiver. 


ngs! 


Digital channel coding 1s a practical method of real- 
izing high transmission reliability by introducing some 
form of error control on the transmitted intormationy ye 
applications where the received signal-to-noise ratio is low 
such as encountered in satellite communication applications, 
error correction coding is usually a necessity for satisfac- 
tory system performance. Error correction is achieved by 
channel coding operation in which extra bits are systemati- 
cally added to the output of the source encoder. While these 
extra bits by themselves convey no information, they make it 
possible for the receiver to detect and/or correct some of 
the errors present in the information bearing bits at the 
receiver. 

There are two principal methods of performing the 
channel coding operation, namely block coding and convolu- 
tional coding. Both methods require storage and processing 
of binary data using a channel encoder and a channel 
decoder. While this requirement was a limiting factor in the 
early days of digital communications, it is no longer a 
critical problem because of the availability of solid state 
devices and memory at reasonable prices. The second part of 
the thesis is devoted to analyzing some examples of block 
and convolutional codes used in conjunction with the direct 
bit detection methods discussed in the first part of the 
thesis. These examples demonstrate that significant perform- 
ance improvements (coding gains) in the order of 2 to 5 dB 
can be achieved with relatively simple block and convolu- 


tional codes. 


IZ. 
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A. SIGNAL REPRESENTATION AND RECEIVER STRUCTURE 
For M-ary phase-shift-keyed modulation with equal signal 
energies, a convenient representation of the signal set is 


given by 


Sy(t) = v2E,/1 cos(2mf.t + 2a(i-1)/M), (eqn 2.1) 
ee Oe ey SL 


where Eau equals some integer. A suitable orthonormal signal 


set for the representation of M-ary PSK signals is given by 


Q,(t) = V2/T cosznf.t, (eqn 2.2) 
ec) = V27l singnf,t , Os tsT 


Using trigonometric identity to expand = s;(t) and 


expressing in terms of 1(t) and 5(t), we have 


s.(t) = VJE,cos(2m(i-1)/M) .94(t) (eqn 2.3) 
- JE.sin(m(i-1)/M) .95(t) 


A plot of the Meary signal constellation can be made 
using ,(t) and @5(t) as axes for various values of M, 


where the coordinates of the ith signal vector is given by 
[VE.cos( 2m(i-1)/M) ee Sern 27 7M) | 
The signal constellation for 4-ary PSK (better known as 


OPSK) and 8-PSK are given in Figure 2.1 for illustration 


purposes. 


is 








Paiguy 6 e2 al Signal constellations for (a) QPSK modulation 
(b) 8-PSK modulation 
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Since a general M-ary PSK signal can be expressed in 
terms of ,(t) and @5(t) and the decision criteria for the 
detection of the signal is based upon phase angle discrimi- 
‘mation, a receiver using P7(t) and Po(t) as correlators 
followed by integration, sampling and phase computation is 
known to be optimum in minimum probability of error sense 
assuming each signal is equally likely to be transmitted, 
and the received signal is contaminated with additive white 
Gaussian noise (AWGN). The corresponding receiver structure 
is shown in Figure 2.2. The same receiver structure can also 
be obtained following a strict mathematical analysis as done 
mi | Ref. 1: pp. 228-230). 

Let the incoming signal over a T seconds interval be 


represented as 


eo enc etyee tone), ~O S cs T (eqn 2.4) 
where 
ecm yaa Ecos 2rf t + 2n(k-1)/M), (een 2.5) 
imme. 5. 


The output from the correlator-integrator is given by 


T 
Y; = ( y(t)p,(tj)dt, 1 = 1,2 (eqn 2.6) 
0 


so that from eqn 2.4 and eqn 2.3, we have 


E 
1 ( Ly een cos(2mf,t + 2m(k-1)/M) (eqn: Z.7) 
° + n(t)] q(t) dt 


= /JE.cos(2m(k-1)/M) + Ne 


where 


a 
il 


r 
a ( n(t)py(t)dt (eqn 2.8) 
O 
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Receiver structure for M-ary PSK modulation 
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so that N. is a Gaussian random variable with zero mean and 
variance N/2, which implies that Y, is Gaussian random 
variable with mean JE,cos( 2n( k-1) /M) and variance N/2, 
conditioned on S},(t) being transmitted. Sa mavdsage iy 


= 
oe ( [/2E./T cos(2mf.t + 21( K-1) /M) (eqn 2.9) 
: + n(t)]@o(t) dt 


= -JE,sin(2m(k-1)/M) + Ng 


where 


T 
No = ( n(t)@o(t)dt (eqn 2.10) 
0 


so that N, has the same statistical properties as N. 
implying that Y5 is also a Gaussian random variable with 
mean -/E,sin( 2n( k-1)/M) and variance N./2, conditioned on 
S(t) being transmitted. It can be shown that Y, and Y5 are 
uncorrelated random variables, and since they are Gaussian, 
they are therefore statistically independent. Therefore 


their joint probability density function (pdf) is given by 





P(Y}/YoIls,(t)) = (eqn 2.11) 
. me cos Oy (y, ~1Es cos Ge) _ (Y, + JE; sin Om)” 
N. 
where 01. = 2nN(k-1)/M. Transforming into polar coordinates 
using Y; = Rcosn and Y5 = -Rsinn, the pdf becomes 


(R/MN,)exp(-(R* -2R/E,cos( -0,)+Eg/No), 


p(R, 1] 5, t)) 


Cpe Oe) =< es 


= OO, otherwise GegminZ 12) 


Integrating over R and writing r = R/VNo,, aqd= See the 
pdf of the phase angle n becomes 


a7 


P(N} s,(t)) = (r/mjexp(-(r* - 2rJ/d cos(q-0,) + d)) dr, 
“TT s<HST (eqn Zula 


= O, elsewhere 


The probability of correctly detecting the kKth  sitoamem 
denoted Pricorrect|s,(t)} is the probability that | 9,,-1 | is 
the minimum for all |95-n], j = 1,2,...,M or equivalentme 
since 0, = 2n(k-1)/M, is the probability that n is in tie 
region [ (2k=-3)n/M , (2k-1)x/M ], therefore 


"; 
Pricormec’ |is.@.) | = ( PC HIs,(t)) dy (eqn 2.14) 
"1 
where ie (2k-3)a/M and N2 = (2k-1)n/M. If we substitute wy 
=n- 2n(k-1)/M in the above equation, we see that 
wim 
Pr (Correct |s.(e) 3 = p(w) dy (eqn 2.4055 
=Ti/m 
which 1s independent of the index k. For equiprobable 


Signals, the probability of correct decisions, denoted POU 


becomes 
Pet) >) Pri correctiisy(&) | fer ain as (eqn 2.16) 
0° T/m 
= (2/m)exp( -d) ( iG exp( <r“) exp(2r/d cosy) dw dr 
O 
0° utan T/m 
= Sane 2 
= (27%) \ expl(=( u-1/d0—) exp(-v“) dv du 
0 o 
where a change of variables using u = rcosw, v = rsinyw has 
been used in order to obtain the last equality. In the case 


of BPSK, namely M = 2, the probability of correct decision, 


P.(2), becomes 


0° | 00 
P.(2)m=0( 2/n) | exp( -(u-VE )*) | exp ~v“) dv du 


= 1 2s one oc) (eqn 2.17) 
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where Q(.)is the complimentary error function defined by 
co 

een) = (a/JiR) | exp(-2z“/2) dz (eqn 2.18) 
x 


The symbol error probability denoted Pp,(2) which is the same 
as the bit error probability for M = 2, is given by 


Pe(2)= 1 - Po(2) = QV2d ) (eqn 2.19) 


since Ey = E. for BPSK. 


B. RELATIONS BETWEEN SYMBOL AND BIT ERROR PROBABILITIES 

As presented in the previous section, symbol error prob- 
abilities can be computed directly from Knowledge of the 
channel characteristics and the derivation can be found in 
many references (see [Ref. 1: p. 231] for example). 
However, for transmission of binary data, and when comparing 
system with different levels of modulation, the bit error 
probability rather than the symbol error probability is of 
interest as explained in the introductory chapter. 
Unfortunately the computation of bit error probability is 
often quite complicated for multi-level modulation system 
and is often not carried or presented in most literature. In 
[Ref. 1: p. 198], the bit error probability has been deter- 
mined only for the case of orthogonal signal sets where the 


result is 


Beg 225> PLM) /( 2" =2) (eqn 2.20) 
with M = number of distinct signal waveforms 
ed) = symbol error probability of the transmitted 
Signal 
Pee jiee—-) bit error probability of Che decoded data bit 
in) = logoM 


a 


While Eqn. 2.z2OQ shows the relationship between biteereas 
probability and the symbol error probability, it is noe 
applicable here because the M-eary PSK signal set is not 
orthogonal. Therefore, the remaining of this section 1s 
devoted to deriving the bit error probability for M-ary PSK 
Signals. Using the notations previously introduced, and 
further defining p, as the probability of k bits in error in 


a received n=-bit data block where k = 1,2,...,n, then 


P= pe (eqn 27235 


Since the events {k errors in a block of n bits} are 
disjoint for sk = 1722. 2m. The average number of bits in 
error given that an n-bit symbol has been detected incor- 


rectly is 


a n 

( ¥ kp, 1/0 ¥ pR ) (eqn 2.22) 
Ksl Ka] 

Therefore the probability that a data bit is in error given 

that an n-bit symbol has been detected incorrectly denoted 

by P( BIS); is given by 


P(BIS) = () kp,)/(nP,(™)) (eqn 2.23) 


Using Bayes’ rule, we can write bit error probability PL(™) 


as 
Ph(M) = P(BIS).P.(M)/P(S|B) (eqn 2.24) 


where P(S|]B) is the probability of symbol error given that a 
bit error has occurred. Clearly this probability equal to 1, 
so that 


n 


PL(M) = P(BIS).P.(M) = }) kp,/n (eqn 2.25) 


Kz] 


ao 


The main problem in the computation of bit error probability 
in the above equation is the determination of the P, Ss which 
is a non-trivial task for multi-level modulation signals. 
C. DERIVATION OF BIT ERROR PROBABILITIES FOR MeARY PSK 
MODULATION ; | 
In general, the bit error probability depends on both 
the symbol error probability and the way in which a block of 
bits are grouped together to form the symbol waveforms prior 
to modulation of the carrier. One popular way of generating 
the symbols is the use of Gray code. Gray coding has the 
desirable property in that a given incorrect decision made 
on a symbol that is adjacent to the correct symbol is accom- 
panied by one and only one bit error. This minimises the bit 
error rate since the main contribution to errors in symbol 
detection corresponds to incorrectly deciding in favor of 
the symbol adjacent to the actual transmitted symbol. 
Examples of Gray coding for some M-ary modulation are 
shown in Figure 2.3 together with the bit error patterns 
based on the all zero symbol as reference. It is interesting 
to note that similar bit error patterns are obtained regard- 


less of the codeword chosen as reference. 


es Pieeer ro, DLObadbi ley for OPSK 


A simplified receiver structure for QPSK modulation 
is possible with the additional advantage of direct bit 
detection at no loss in performanse [Ref. 2: pp. 120-124]. 
The receiver structure and the signal constellation with 
Gray coding assignments are shown in Figure 2. 4. 

From a close examination of the block diagram of the 
receiver structure for QPSK as shown in Figure 2.4(a), it is 
found that both the in-phase I channel producing the output 
¥, and decision a, and the quadrature Q channel producing 
the output Y5 and decision a> are each similar to a BPSK 
demodulator. The I and Q channels provide direct detection 
of the 2-bit symbols associated with the QPSK modulation. 
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Figure 2.3 (a) Gray code assignment and 
bit error pattern for QPSK (b) Gray code assignment 
and bit error pattern for 8=-PSK 
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Figure 2.4 (a) Receiver structure for QPSK 


(b) Gray code assignment and signal constellation for QPSK 


Ze 


Furthermore, the symbol error rate performance of the two 
orthogonal channels are the same. Therefore, the symbol 


error probability of each channel is given by 


Per = Peo = Peppsk = 2(/2E,/No) (eqn 2.26) 


The bit error probability is obtained by observing that 


Py = Pr) 1 bieerroms) 
= Pr{ a, and a} but not both jane Gigerue ws 
= 20(./2E,/N,)[1.- (/2E,/N,)] 
Po = Pr{ 2 bit error } = Pr{ aj, and¥a, Suvericrws 


= [Q(./2E,/N,) 17 


so that the resulting bit error probability, P,(4) is given 
by 
Pete) = O. Spy + Po (eqn 2.27) 


Q( /2E,/N,) 


It is interesting to note that the bit error prob- 
ability for a Gray coded QOPSK is identical to that of Bros 
where the same bit energy-to-noise ratio is maintained for 
both systems. This is a special case whereby there is no 
performance penalty in the bit error rate when a higher 
order of modulation is used in place of a lower modulation, 
namely QPSK in place of BPSK. 


2. Bit error probability for 8=—Pskessaiemar 
The bit error probability of the standard receiver 


structure shown in Figure 2.2 is now considered for the case 
of 8-PSK signal with arbitrary phase angle separation as 


shown in Figure 2.5. Define 
Py = Pr{ 1 bit error|s,(t) } 
= Prjs5(t)lje,(t)} + 2r(e,qe Ne neee 
+ Pr{se(t)/sz(t)} (eqn 2.28) 
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for arbitrary phase angle spacings 8-PSK signal 
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Considering each term individually in the Eqn. 2.28, we have 
me Se) |S S) | = 


Pinel, (+n)tale sm ¢ (i 2myenl eae 


= Lm | ol fo _ (SE +0,) tan( (B- #)) ] 4 
lane /No/2 JSNo/2. aed | n; 


where n, and no are the components of the additive white 
Gaussian noise along the 9,(t) and 95(t) axis. Let x*/2 = 
N,“/N,, this implies - 


PEt JS5(t) ion =) ee 


(ae Q (Jd + x) tanh 
dg, fan + x)tan) - @ (atx) (-9)) | de 
where d = E/N: Similarly, we can obtain 

Pr{ s4(t)|s,(t) } = 


-/74 aye 
[ose * [8 (ad +a}ton$) ~ @ ((fa + x)400(2-f) ] de 


= 00 
Pe tesGenleice | = 


po 2 
Lame [ 9 ( (0 +x)tain¥ )- @ ( (na ++) 400(8-)} ae 


Combining all the three terms of the above expression for 
the equation of Py given in Eqn. 2.28 and after some simpli- 


cation, we obtain 


Py) =) 22, 2 bit error) — tees 
00 _x/, 
» | 2 aaa A 
J ae | @ ( (i+ «+ M4 ) @ ( (a+ x)-+0 ( z)) | 
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. 3 O78 L 9 ((Ri+x) ton$ = ( (+x) ton(-B)] dx 


), iam 
sami larly. 
Poe Ere Dit error|s,(t) } 
= Pr{s3(t){[sy(t)} + Pr{sco(t)]s,(t)} + Pr{s7(t)|s,(t)} 
Be i 2 */, 
ha [0 (28 +x) tool F-8)] a 
-- 94 -x7, 
+ | ae *[ & (tates) 400 (F-,)) | a 
ee, 
Go * | a [- (zarx)tonfh) - 0 ( (121+) ton) | ds 
-f94 ae 
+f he [0 (tes) 0 ¥-#)) | d 
- 60 
-X/; 
+ {- ae [9 ( (1a +x) ton(- “a))]o> 
S24 
= [dé “2 Tg ( (tex) +00 (2-3) #)) - @ ( (1d »)t0n(3-8)) |x 
<)4 _x7/ 
+ | me *[9(-(atex)tnft) (ion) 4003) | 
Banally, 
Bees Fr, 3 bit error|s,(t) } 


= Pr{ so(t)|sy(t) } 


pedantic 
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Furthermore, it can be shown that the same expressions for 
Pj- Po. P3, are obtained when conditioned on the other 
signal s,(t) being transmitted, i = 2,3,...,8 so that the 
bit error probability P,(8) becomes 


Po(8) = py/3 + 2p5/3 + ps3 (eqn 2.29) 


Bit error probabilities with different values of @ 
and $B were computed with the aid of a computer. It can be 
verified from the numerical results that the lowest bit 
error rate occurs for the case of equal angle spacing, i.e., 
Go. Sa Sos The bit error probabilities for the cases @ = 
30°%..36"- Ace 54°, 60° have been plotted as shown in Figure 
pg oe 


3. Bit error probability for 16=PSKsicmal 
The performance of the receiver shown in Figure 2.2 
was analyzed for 16-PSK modulation having the signal 
constellation shown in Figure 2.7. Observe the use of equal 
angle separation for the signal vectors with Gray bit codes 
assigned to the signals. 


Assuming that the transmitted signal is s,(t), then 


Pi = Put one Bie errors (=) 


Priso(t)iisq(t)} + Prisg( fies 


+ 


Pr{so(t) |s4,(0)} * Prise.) sien 


2 (Poe [‘s ( ([ed+ x) tanti.25°) - @( (Ia + -) 4003.15") dx 
~fta 


Se 
S aan [9 ((ea + «)tens6.25') — @ (mx) ton 18.159) 
~ 2d 
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~S2d 


+ f me ‘tg [a ((izd + x) tani. 25°) - & ( (J2d+ x) tan 33, as) | d x 
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E2qgure 2.6 Bit error probabilities for 8-PSK 
Standard phase detector with different 


phase angle spacing 
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Figure 2.7 Signal constellation for 16-PSK signal 
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Similarly 


eo Pret 2 ae error|s,(t) } 


meee oe 0c) teri Se(t) |sa( ey} + Priso(t)|s,(t) } 


peer eae Sas) j= Pr {si 4(t)|/s,(t)ji + Prisi6(t)is,(t)} 


= 43 me [8 (i+ x)4on33.5) - 0 ( (1a tx) te 56.25°) | do 
a 2 (ape [ 9 ((l+x) tan 0.95") | dx 
-J94 _ 
fo me 2 La (ed +) 40033. 95") ~ 4 ((a+ x) 4006.25") | 
r [a "8 @ ((sai+x) ton(-u.25) EA (C2 +x) ton .25¢) | 
Also 


Pee ae thy obit error}s,(£) } 


Prisg(t)]sz(t)} + Pr{s,9(t)]s3z(t)} 


= Priszo9(t)!s,(t)} + Prf{sj,(t)[s,(t)} 


ae 
2[ ge” | 9 (ad ex)tan5t. 25°) ~ 0 (sax) 18.75°)] d 


wd 


= = 


ey 
| ie [9 (tn) tes.25%)— 0 on) 08.15] 


oe 


and finally 
Pa = FPr{ 4 bit erroris( om 
= Eo Sree) eee 


fA xy 
. me 2 */a ((1a + x) 4an33.25°) - a( (s+ «)tons6.259)| clx 


It can be shown that the same expressions for Py. 
P2, Pz, and pg are obtained conditioned on all other signal 
Se ey being transmitted, 2 = 27...) uc Thus, the bit erren 


probability becomes 


EO) apa es Po/2 + 3p3/4 + P4 (eqn: Z. 307 


When the above integral expression for pj, Po, P3, 
and py, were evaluated numerically on a computer, it was 
founda that, fori d = B7e 2 5 dB, the integrals whose limits 
range from negative infinity to -,//2d were so small that no 
difference in the overall results were obtained by ignoring 
their contribution even when using double precision computa- 
tion on the IBM 3033 computer. The bit error probabilities 
of 16-PSK were plotted in Figure 2.8 along with those 
obtained from equal angle spacing 8=-PSK and QPSK. The curves 
were plotted using bit energy-to-noise ratio on the hori- 
zontal axis thereby providing a fair basis for comparing the 
different levels of signal modulation. It can be observed 
from the curves that bit error rate performance deteriorates 
with higher order M-eary modulation which is an expected 
result. At bit Error ratewsor 107> or less, the performance 
loss is about 3.5 dB between QPSK and 8-PSK and 4.5 dB 
between 8=-PSK and 16-PSK. 
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Figure 2.8 Bit error probabilities vs E,/No 
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Ill. Bit DETECTION RECEIVERS POR D2 3 


In Chapter 2, it has been demonstrated that direct bit 
detection can be achieved with QPSK signalling at no loss in 
bit error rate performance. This approach of direct “base 
detection will be extended to 8-PSK and 16-PSK modulation by 
suggesting possible receiver structures and computing their 
bit error probabilities. The results are then compared with 


those obtained from the standard phase detection receivers. 


A. DIRECT BIT DETECTION FOR 8-PSK 

The signal constellation for 8-PSK modulation with Gray 
bit coding assignment and the receiver structure for direct 
bit detection were shown in Figure 3.1. For the Gray bit 
coding assignment, it can be seen that the detection of the 
most significant bit (MSB) requires a decision as to whether 
the received signal vector falls on the upper or lower half 
of the signal space. The detection of the least significant 
bit (LSB) requires a similar decisions as to whether the 
Slgnal vector is in the left half or right half of the 
Slgnal space. The detection of the middle bit is slightly 
more complicated. The received signal component along the 
~,(t) axis is squared and compared to a threshold in order 
to determine whether it is a logical O's or a logical 1's. 
From the signal space diagram, we see that for the two 
Signal vectors that lie in the same quadrant, the components 
along the Py axis are given by +./Ecosa/2 or +./Esing/2. Le 
would therefore be appropriate to choose the threshold at 


0. 5[Ecos*(a/2) + Esin“(a/2)] = E/2 


Such a receiver structure provides a simplification in 
hardware implementation over that of a standard phase 


detector and was first proposed by Thompson [Ref. 3]. 
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Thompson constructed the receiver structure of Figure 3.1(b) 
and carried out an experimental evaluation of the system's 
bit error rate performance at two angle settings, namely «@ = 
36.8° and a = 45° (equal angle spacing). The experimental 
results demonstrated that the phase angle setting at @ = 
Bene gave a better bit error rate performance than for 
equal angle spacing. The experimental results were however 
not supported by any analytical studies. 

In the following, analytical results are presented in 
order to evaluate the bit error rate at arbitrary phase 
angle spacings between signals for the receiver proposed by 
Thompson. The optimum phase angle spacing was computed and 
the bit error rate compared to that of a standard phase 
detection receiver. 

De Pee rma Pri@iiss.serror }) and n, as the noise compo- 
nent along the @4(t) axis. Using the symmetrical properties 
of signal vectors about the @,(t) and @o(t) axes, we need 
only consider the two cases conditioned on s,(t) and s(t) 
being transmitted. This together with the condition of equi- 


probable signals allowed p,, to be written as 


C25 ar Neb error|s,(t)} 
+ Pr{MSB error|s5(t)} ] 


Pem 


~fEs int, ny’ “LE ws = nf 
-_ —_— | eee e A, di + wl eal: e€ No d n 
2 - STN, n; i STN, 


(eqn 3.1) 


=a 


ME. & Jt 2E « 
z 0 (Een) 7 xO ([fE coss ] 


Similarly, it can be shown that with Palen cre> error), 
Pee Pean- For the detection of the middle bit, we proceed 
with the following analysis 


or, 


: . (UY -S ¢ . 
p(y, | Sc) = TN, exp [- ee), C= 


where s,;, is the component of signal s;(t) along the Py 








axis. Define z = var so that 
= (2- 25S + Su) 
plz/sm) = Trae | © (- Ne } 
2 
+ exp (- (z+ 2Sulz + Si, ) ; 7>0 
No 


O ; otherwise 


il 


Define p,; = Pr{middle bit error}. It can be shown that like 
the case of p.,, we need only consider the two cases condi- 


tioned on s,(t) and s5(t) being transmitted so that 


Dawes 0.5 Preimiddle ba error|s,(t)} 
+ Priimiddle bit €xror|s> Ge) ja 
E/2 0° 
= 0.5[ ( p(z|s,(t))dz + { p(z|so(t))dz] (eqn 372) 


o E/2 
Analyzing each term separately, we have 


E/2 | 
EX p [- 
2/7 N,z 


/2 
! _ (7625 oe 
f- TN, 2 exp [ ae d 2 


6 0 








("ple sin) di = { P Seen | dz 


0 0 





: _ exp (- a pated) os 


6 
4 (” Lovee (- (ct 250% # St) By 
, Tim, “*F No / . 


oo 


where the substitution x = /z has been made. Normalising 
the integrand to a normal Gaussian distribution with zero 
mean and unit variance, we obtain 


7 Fin *1%f ; 
{" plz|sm)de = f ge 


Jz 
0 - S/T, 
(9 Fn, + Su Reg | _x/, 
i Gas: d x 
Sw/fizp | 


= (es) = (Aas) + 0 (i) - 8% ra 
@ (fE - [2 cos $ :) - a //E + 2E cos 7) 


Furthermore 


[ pl? |S.) dz = | Tene? (- at Fie 


E/, 


oe [hex _ (x4 LS + San) 
; 0 


(Ten) + 9 (FR + pee) 


a (fg, ~ FFE sing + 0 (/E + x Sin §) 


so that 


Ro = r[1- Off - PE cost) - OU, + feo?) | 
+2 [O(K -Resns) + o[ fi + fe mt) | 


Se 


We obtain finally the bit error probability P,( 8) from 


Ph(8) = 2Pap/3 + Pes /3 (eqn 3.3) 


The bit error probability (P,(E)) versus bit energy-to- 
noise ratio (E,/N,) has been plotted over the range of @ 
between 28° and 40° running in 2° step increments and the 
results shown in Figure 3.2. An interesting result to note 
is that the bit error rate is not optimum at equal phase 
angle spacing. Using’ a computer search algorithm, it was 
found that the phase angle spacing for optimum performance 
varies over a small range of values depending on the size of 
the bit energy-to-noise ratio. The optimum phase angle 
versus the desired bit error rate (and its corresponding 
E,/N,) were tabulated in Table 1. It can be seen from the 
values tabulated that for lower E,/N, (i.e., values smaller 
than 13.2 dB), the optimum phase angle a@ equals 36°. At 
higher E,/No, the optimum phase angle @ decreases and equal 
822 Stor ES Gey a 107° which represents a nominal design 


figure for most applications. 


TABLE 1 
OPTIMUM ANGLE SPACING VERSUS DESIRED BIT ERROR RATE 


P(E) E_/NG (dB) Optimum @ 
5 107° «= eel Ome Tor? = Vere 369 
6.107* - 2.107? 1360 Sasa, 34° 
CD iGa Se, 320 
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Figure 3.2 (a) Bit error probabilities for 8=-PSK 


with bit detection receiver a@ = 28° - 32° 
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Figure 3.2 (c) Bit error probabilities for 8-PSK 


with bit detection receiver a@ = 36% - 40° 
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Choosing an angle @ = 32°, the bit "error = fates 
computed and plotted alongside the bit error probabieie, 
derived in Eqn. 2.29 for a standard phase detection receiver 
as described in Chapter 2. The results are shown in Figure 
3:3. Al aidesiued = cmos Ome the bit detection receiver 
is seen to be 3 dB worse in bit energy-to-noise ratio 
compared with the standard phase detection receiver. The 3 
dB represents a significant loss in performance. Moreover, 
the receiver requires a threshold setting of E/2 for the 
middle bit which is signal energy dependent and requires an 
automatic gain control (AGC) circuit for system adaptation 
so that a search for a better receiver is justified. 

An alternate receiver structure is described in the 
following section whereby the same theoretical bit error 
rate of the standard phase receiver can be achieved with 
direct bit detection and at the same time allowing for a 
Simplification in implementation in that only zero value 
thresholds are required so that there is no need for a ACC 


Cirew Lt. 


B. MODIFIED BIT DETECTION RECEIVER FORVc=Fok 


The receiver structure presented in the previous section 
was modified slightly to obtain an improvement in bit error 
rate performance. The modified receiver structure is shown 
in Figure 3.4 whereby the modification involved only a 
change in the detection method of the middle bit. The middle 
bit is obtained by evaluating (ve - oul and comparing this 
value to a zero threshold. This method is preferable also 
from the point of view that the receiver uses the thresholds 
that are signal energy independent. This 1s important 
because it eliminates the need for system adaptation and the 


use of automatic gain devices. 
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The error probability associated with middle bit is now 


determined by first obtaining the conditional pdf of (¥,% - 


i) = cos2n. Conditioned on sj,(t) transmitted, correct 
decoding of the middle bit occurs when the received signal 
has positive values for cos2n. This implies a zero value 


threshold for the middle bit instead of E/2. Since -™ < Qh s 


t, 
Pr{middle bit correct|s,(t) transmitted} = Pr{coszn 2 0} 
= Pr{-7/4 < n s m/4} + Pr{-7 << n s -3N/4} 


+ Pr{3n/4 << 7} (eqn 3.4) 


Therefore the error probability for the middle bit can 
be derived by computing the pdf of n, the phase angle of 
the received signal vector. The derivation of the pdf of jn 


can be found in [Ref. 4] where 


-d an 
p(n] sit) 7 [14 Jand cos n! e 0st a (-F cosa’) | ; 


1 


hte Nn <7] (eqn 3.5) 
= 0; otherwise 
where ni =n - 0; 
0. = phase angle of signal vector S5 


d = E./N, = 3E,/N, for 8-PSK. 


Using the properties of rotational symmetry and equiprobable 


Signals, 
Pr{ middle bit correct|s,(t) transmitted } 


peer middie bit” correct} for any i (eqn 3.6) 


47] 


T1/y 2301/4 


2 p(nisy(t))dan + \ p(nisz(t))an 


-1/4 T -TT 
‘ ( p(nisq(t))d 


31/4 


The above integrals can be evaluated numerically on a 
computer. It was found that for E,/N, 2 53 dB, the contribu- 
tion from the last two integrals is insignificant even when 


using double precision computation. Therefore 


Frimiddle bit erron) )— ba (eqn 3.7) 


ttle 
= p(n} sz(t))an 


=1/y 


So -thac 


Pio) = elem oe (eqn 3.8) 


For the modified receiver structure of Figure 3.4 [ge 
was found that the optimum performance occurred with equal 
angle spacing between signals, ie a = 45° and that at ome 
optimum angle spacing, the bit error rate equals to those 
obtained for a standard phase detection receiver. This is a 
Slgnificant resulé in that similar performance can be 
achieved using simpler hardware structure and at the same 
time providing for direct and parallel bit decoding. This 


provides a potential for high speed data rate applications. 
C.. DIRECT BIT DETECTION FORMie- Eon 


The results obtained for the modified bit detection 
receiver when 8-PSK modulation is used, have provided moti- 
vation for the proposal of a bit detection receiver for 
16-PSK modulation. The receiver and the signal constella- 
tion with bit code assignments are shown in Figure 3.5. 
Again only zero value thresholds and simple arithmetic oper- 


ation like multiplication and subtraction are needed. 
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Decisions for the first and last bits are based on the 
components of the received vector along the 9, and > axes, 
i.e., Y, and Yo respectively. Decision for the second bit is 
based on the value of Cec — ee) = cos2n in comparison to 
a zero threshold. The decision for the third bit can be 
obtained by evaluating the value of cos4n and compared 
with a zero threshold. From the above description of the 
detection mechanism, the bit error performance is next 


derived. Define 


Peay — Pr{ist bit error} 


Peper 2t i 2nd bit error} 
Pas Pej srdybit error} 
Pea Fri tth bit error} 


Using the properties of rotational symmetry of signal 
vectors and equiprobable signals, Pe, can be obtained by 
considering only the four cases conditioned on S4(t), So(t), 


Bele), and s,(t) being transmitted, i.e., 


Pe, = 0-25| Pr{ist bit error|s7(t)} + 
Piast 61 ¢ error|s.(t)} + Prj{ist bit error|s3(t)} 
er etcOre|sn( ci} | 


Following a similar analysis as was carried out in Eqn. 3.1 
for 8-PSK, it can be seen that 


Pei = Pea = 0-251 QO(V2E/N, sina) + QO( /2E/N,cos@) 
+ Q(/2E/N sinB) + Q( /2E/N,cosB) ] 


For the 2nd bit, the decision is based on the parameter 
aa - ee) = cos2yn where yn is the received signal vector's 
phase angle. The pdf of n conditioned on s,(t) transmitted 


1S given by 
Poe ere 1 deos*Q' / 
p(n] ict) ) a [ 14 [umd cosN’. e 0 (-I cos’) j 


Su 


(eqn 3. oy 
=e (Cy, otherwise 
where ni = n - 0; 
U5 = phase angle of signals. ©) 


d = E./N, = 4E,/N, for 16-PSK 


Using the properties of rotational symmetry and equiprobable 
Signals, it can be seen that p,5 can be obtained by consid- 
ering only the two cases conditioned on s,(t) and s(t) 


transmitted. Therefore 


Pr{2nd bit correct} ~— 0. 5| Pr) Zucdeoar correct|s,(t)} 
+ Pr{2nd bit correct|sj(tjy 
tly 

Peo ee Oe ( p(ni]s,(t))dn 
: -ly 

nly 

= ( p(niso(t))dn ] (eqn 3.10) 
-@/y . 


In Eqn. 3.6, the insignificant contrabucvens freeneea] inte- 
gration of p(n]s,(t)) and p(nl|so(t)) over [=x , =-3n/4] and 
[3n/4 , m] have been left out. For the decision on the third 
bit, the value of cos4n was computed and compared to a zero 
value threshold. A bit value of 1's is assigned if cos4n 2 


O and this happens when n falls in the following regions: 
[-7,-77/8], [-52/8,=-3n/8], 
[=%/78,1/8.], |3n/78 Suey (7x7 

Using the properties of rotational symmetry and equiprobable 


Signals again, we obtained 


Pe3 — 1 = Prilesmt78 seat ©) Slee er (eqn 3. 1 
- Pri-n/8 < i\s,(€) = 878i ni Hl s,(t)s57/78} 


SZ 


here> y mene sIiciqniiricant Contribution from the integration 
of p(nls,(t)) over the range [-~7,-72/8] and [77%/8,n] has 
been left out. The bit error probability is then given by 


PH(16) = pei/2 +*Pe3/4 +Peg/4 (eqn 3.12) 


Numerical evaluations of the bit error probabilities 
were obtained with the aid of a computer. Again, it was 
found that optimum performance occurred at equal phase angle 
spacing between signals. The plot of bit error rate versus 
bit energy-to-noise ratio is shown in Figure 3.6 for the 
ase Of equal angle spacing (@ = 11.25°) and also for 
unequal angle spacing where a@ = 10°. In the latter case, a 


-6 was incurred. 


He55 Of 1 GB Signal-to-noise at P(E) = 10 
The bit error rate for the case of equal angle spacing 
between signals agrees with that derived for a 16=-PSK modu- 
lation standard phase detection receiver. This result 
together with the result obtained for a 8-PSK modulation 
suggest that for any M-ary PSK signal, it is likely that a 
direct bit detection receiver will always exist, having a 
theoretical bit error rate performance that is similar to 
that of a standard phase detection receiver. By carefully 
structuring the receiver, we can obtain parallel decoding of 
bits and also simplification in the hardware implementation. 
This result is important considering the present trend of 
using higher order modulation techniques due to the ever 
increasing demand for higher data rates in all forms of 


information transmission. 
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IV. FORWARD ERROR CORRECTION CODES 


There are two different types of codes in common use 
today, namely block codes, and convolutional codes. In block 
coding, a sequence of bits is generated by a binary source 
which are then grouped into blocks of k bits long. To each 
of these k=-bit blocks, (n-k) redundant symbols are are added 
to produce an n-symbol codeword. The (n-k) redundant symbols 
are referred to as the parity symbols. The result is denoted 
as an (n,k) block code. Since each codeword contains n 
symbols and conveys k bits of information, the information 
rate of the encoder output is k/n bits per symbol. This 
ratio k/n is also referred to as the code rate. 

The encoder for a convolutional code also accepts k-=bit 
blocks of information, and produces an encoded sequence of 
n-bit codewords. However, each codeword depends not only on 
the corresponding k-bit message block at the same time unit, 
Bucealso On mM previous message blocks. Hence, the encoder 
has a memory of order Mm. The set of encoded sequence 
produced by a k-input, n-output encoder of memory order m is 
called an (n,k,m) convolutional code. The ratio R = k/n is 
also the code rate as before. Since the encoder has memory, 


it must be implemented with sequential logic circuit. 


A. SINGLE ERROR CORRECTING HAMMING BLOCK CODE 

The single error correcting Hamming code form a class of 
block code which is known as perfect code in that all single 
errors and no other are correctable. For any positive 
integer m 2 3, there exists a Hamming code with the 


following parameters: 


Code length : one ml 
Number of information symbols: w= 2 = m — 
Number of parity-check symbols: (n-k) =m 


>> 


Error correcting Capacilic. t = l(i.e. single error 
correction) 

From the development of [Ref. 5 : pp. 79-81], the unde- 
tected codeword error probability of an (n,k) Hamming code 
is given by 


m= m 
P(E) = 27™{1+(2™-1)(1-2p)4 } - (1-p)47+ (eqn 4.1) 
where m = nek and pis the transitional probability of the 
binary symmetric channel (BSC) with additive white Gaussian 


noise interference. 


For a (7,4) Hamming code, m = 3 so that 
Pj(S) = 0. 125{1 + 7(d=2p)-) eee (eqn 4.2) 


Comparisons of coded and uncoded bit error rate perform- 
ance must be done on an equitable basis. One way to do this 
1s to require an equal transmitted message rate for both the 
ceded and uncoded systems. For an encoded n-symbol code- 
word, the symbol energy is reduced somewhat because of the 
Shorter bit duration when compared to the bit duration of 
the uncoded message sequence. Consider a k-bit message block 
encoded into an n-bit symbol block for transmission. The 


average symbol energy in the encoded sequence is reduced to 


where Ey is the bit energy of the original uncoded message 


sequence. 


1. Codeword error and bit error probabilities 
The exact relationship between the codeword error 


probability of the transmitted sequence and the bit error 
probability of the message sequence is generally complicated 


and depends on the method used to generate the n=-symbol from 


BS 


the k-bit. Most references (see [Ref. 6] for example) 
compute upper and lower bounds or derive approximations to 
decoded bit error rate relationships based on high signal- 
to-noise assumptions. For an (n,k) code, if TF denotes the 
average number of message bits in error for each codeword 


eeror, the bit error probability is given by 
eG) ee TPE Gears (egn 4.3) 


which is simply the ratio of the number of message bits in 
error to the total number of symbols in the codeword. The 
worst case occurs when each undetected codeword error 
results in k message bit error. This yield the simple upper 


bound 
Ee ee a) (eqn 4.4) 


The lower bound is obtained by considering the most favor- 
able situation in which each undetected codeword error 
results in only one message bit error. For this case, [ = 
1, and 


P(E) > Py(E)/k (eqn 4.5) 


For a perfect code with t-bit error correcting capability 
and if the signal-to-noise ratio is sufficiently high, the 
undetected error is most likely due to (t+l) bit errors in 
the codeword. Of these (ttl) bit errors in the codeword, 


(t+l)k/n are, on the average, message bit errors. Thus 

Fr = (t+1)k/n (eqn 4. 6) 
and the approximation 

Ee ee ee eye 4) 7 (eqn 4.7) 


result. The exact value of PL(E) for the (7,4) Hamming code 


Will be derived next and compared with this approximation. 


om 


Ze Bit error probability for (7) 43) gamma. code 
A (7,4) Hamming code can be generated using the 
generator polynomial g(X) = 1+X+X° The message blocks and 


the corresponding codewords are shown in Table 2 below. 


TABLE 2 
A (7,4) HAMMING CODE GENERATED BY G(X) = 1+X+x°? 


Message Codeword 


Q000 
1000 
0100 
Toe 
OO10 
1010 
92, 16, 
Tre 
eGor 
LOOr 
0101 
Od 
OO1l1 
TO 
Oar 
ie 


0000 
Lion 
0110 
Lone 
Ee 
VOL) 
1000 
O1Om 
1010 
OT 
LOO 
OO0O01 
0100 
LO@a: 
0010 
Le 


000 
000 
100 
100 
010 
010 
110 
110 
001 
001 
101 
101 
O11 
O11 
111 
111 





The standard array is next constructed and shown in 
Table 3. The seven correctable single error patterns and 
the all zero pattern are used to form the first elements in 
each column and the sixteen valid codewords are used to form 


the first elements in each row of the standard array. 
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The remaining elements in the array are generated as 
follows: let D denotes the jth column of the standard 
array. Then 


D; ={v G5tV4, @35V . 0 eae 


a J J J 


where V5 is a valid codeword and Q5,€3,-.--,@g are the single 
error patterns Known also as the coset leaders. Using these 
rules, the columns in the standard array of the (7,4) 
Hamming code are constructed and the array shown in Table 3. 
Suppose the codeword ‘v, is transmitted over a noisy channel. 
We see that the received codeword r is in D; if the error 


pattern caused by the channel is a coset sae and hence 
will be decoded correctly into the codeword V¥- 

Since the coset leaders are single error symbol 
patterns, undetected errors occur only when there are two or 
more symbol errors in the received symbol pattern. It can be 
shown that if the transitional probability p of the binary 
symmetric channel is in the order of 107% or less, the only 
Significant contribution to the undetected error probability 
comes from the 2-symbol error patterns in the codeword. 
Based on this, an algorithm is devised in order to compute 
the average bit errors in the message block given that a 
2Z-symbol error have occurred in the received codeword. The 
is done as follows: conditioned on each of the sixteen 
possible codewords, all Z-symbol error patterns are 
computed. These erroneous code patterns are then ‘corrected’ 
using the standard array into its corresponding coset 
leaders and then decoded into the corresponding message 
blocks. From this the average message bit error probability 
can be computed. This procedure is best illustrated with an 
example. Conditioned on the all zero codeword transmitted, 
the possible 2-symbol error codewords, the ‘corrected’ code- 


words of the coset leaders and the message blocks are 
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computed and is shown in Table 4. Of the 21 possibilities 
of double symbol errors in the received codeword, nine of 
them yield single bit errors while another nine result in 
2-bit errors. The remaining three possibilities produce 
3-bit errors in the message blocks. 

The same computation of the bit error patterns were 
carried out for each of the other 15 codewords assumed to be 
transmitted. Similar results to those obtained for the case 
in which the all zero codeword was assumed transmitted were 
observed due to a property that Hamming codes possess that 
puts them in the class of so-called perfect codes. It is 
possible to conclude now that [T, the average number of 
message bit error given that an undetected codeword error 


has occurred is given by 
[( 9x1) + (9x2) + (3x3)]/21 = 12/7 


Therefore, the bit error rate in the message block for a 


(7,4) Hamming code is approximately given by 


PA(E) = FP,(E)/k = 3P,,(E)/7 (eqn 4.8) 


3[1+7(1-2p)*] /56 - 3(1-p)’/7 


Comparing this result with Eqn. 4.7 which states that Ey a) 
meee )//, 1t can be seen that the approximation is off by 
a factor of 2/3 which is reasonably good for the simple 
estimate developed. 
B. SINGLE ERROR CORRECTING AND DOUBLE ERROR DETECTING 
HAMMING CODE 
The Hamming code is also a cyclic code in that every 
cyclic shift of any code vector results in another valid 
code vector. The cyclic Hamming code can be modified so as 
to be able to correct any single error and simultaneously 


detect any combination of double errors. 
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TABLE 4 


COMPUTATION OF AVERAGE, BIT ERROR IN MESSAGE BLOCK 
FOR A (7,4) HAMMING CODE 


Conditioned on codeword OQOOOOOO transmitted 


2-bit error 





codeword 


0101000 
1001000 
1100000 


0010100 
0100100 
0110000 


0001010 
0010010 
0011000 


0000110 
1000010 
1000100 


0010001 
1000001 
1010000 


OO000101 
0001001 
0001100 


0100001 
OO000011 
0100010 


Coset 


leader 


1101000 


0110100 


COLIC LO 


1000110 


1010001 


0001101 


0100011 
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Message 


block 


1000 


0100 


TORE 


Ovea 


OOO1 


dealt 


OO1ll 





# of 


bit error 





In application where retransmissions are allowed and easily 
accomplished, this is definitely an added advantage. A 
sSingle-error-correcting and double-error-detecting Hamming 


code of length 2™-1 is generated by the polynomial 
Ces) (oe) D(X) (eqn 4.9) 


where p(X) is the primitive polynomial of degree m used to 
generate the single-error-correcting Hamming code. Note that 
this code has (m+1) parity check bits and is denoted as a 
(n,kK=-1) code. : 

Let Cy and C5, represent the single-error-correcting 
Hamming code and its corresponding modified code providing 
double-error-detection respectively. It can be shown [Ref. 
5: pp. 113-114] that the minimum distance of code Cy is 4. 
Also this distance 4 Hamming code C5 consists of all the 
even weight code vectors of the corresponding distance 3 
code C,, and the undetected error probability of this code 
when transmission takes place over a BSC is given by [Ref 5: 
mee 115-116], 


m=} m 
P(E) = 270M 1) ¢142(2™1)(1-p)(1-2p)* ~14+(1-2p)274} 
-(1-p)#7 (eqn 4.10) 
where p is the transitional probability over the BSC 
channel. 
For the (7,3) Hamming code C» the general formula above 
becomes (m = 3) 
P(E) = 27*{14+14( 1-p)(1-2p)3+( 1-2p) 7} (eqn 4.11) 
u gq : 
- (1-p)/ 


Following the same type of analysis as carried out in the 


previous section in order to compute the average message bit 
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error probability, a search for all possible 3=symbol erro. 
in the received codeword is performed. The same standard 
array presented for the (7,4) Hamming code and shown in 
Table 3 can be used to correct the 3-symbol error codewords. 
Note that all the 3-symbol error patterns are always '‘'cor- 
rected' as a valid codeword (i.e. one with even weight). 
This is illustrated in Table 5 which shows all the possible 
3-symbol error patterns and the corresponding coset leaders 
based on the assumption that the all zero codeword has been 
transmitted. 

Since there are eight valid codewords in C5, each code- 
word is assigned to a 3-bit message block. It can be seen 
from Table 5 that when a 3-bit error occurs, it is equally 
likely that any one of the seven remaining codewords is 
assigned. Hence there is no prefered way of assigning the 
message bits to the codeword so as to reduce the average bit 
error rate in the message block. The same results were 
obtained when the computation was carried out under the 
assumption of other codewords being transmitted. Therefore 
the average number of message bits in error given an unde- 


tected error has occurred is given by 
r = [{(3x1l + (3x2) + (1x3))/7 = 12/7 


which is identical to the previous result. The message bit 


error rate then becomes 


Ph (E) PP (E)/k = 4P,(E)/7 (eqn 4.12) 


{1+14(1-p)(1-2p)3+(1-2p)’}/28 - 4(1-p)’/7 
The two different forms of the Hamming code are now 


applied to digital transmission via an optimum 16-PSK modu- 


lation channel in order to illustrate possible coding gains. 
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TABLE 5 
COMPUTATION OF AVERAGE MESSAGE BIT ERROR 
FOR A (7,3) DOUBLE-ERROR=-DETECTING HAMMING CODE 
** Conditioned on the codeword OOQOOOOO transmitted 


3-bit error patterns coset leader 








Oa LOO 
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HHO, 
HOH 
OOOO 
OOOO 
OrRHH 
OO0OO 
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OOOO 


OL ToOor 
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The comparisons between the coded and uncoded case were made 


assuming equal transmitted information rate so that the 
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symbol energy-to-noise ratio for the coded case is reduced 
by a factor of k/n. The performance associated with 8-PSK 
modulation was included for comparison purposes. Figure 4.1 
shows the four curves of the bit error probabilities as 


follows: 
(a) 16-PSK receiver without coding 


(b) 16-PSK with (7,4) Hamming code 
(c) 16-PSK with (7,3) single-error-correcting and double- 
error-detecting Hamming code 
(d) 8=-PSK receiver without codmng 
Figure 4.1 illustrates the superiority of channel coding 
especially when operating under weak signal-to-noise condi- 
tions. For example, if there is a constraint on E,/N, to be 
equal to or less than 9 dB, the results yield the following 
bit error rates (BER): 


16-PSK without code : BER = 3x107% 
16-PSK with (7,4) code: BER = 5x107* (decoded) 
16-PSK with (7,3) code: BER = 1x107* (decoded) 
8-PSK without code : BER = 3x107° 


The reduction in BER is in the order of a factor of 10% with 
coding whereas the BER reduction obtained from reducing the 
order of modulation to 8-PSK is only in the order yo 7 
factor of 10. For high signal-to-noise ratio, the perform- 
ance gain associated with 8-PSK is only 1 dB better than 
that of the coded 16-PSK. The above comparisons take into 
account the reduction in E,/N, inherent with coding so that 
equal information transmission rates in all cases are main- 


tained without having to increase the transmitted power. 
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Figure 4.1 Bit error rate comparisons of 


16-PSK with and without Hamming code 
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Another point worth noting is that for the (772 )=hanmeam 
code, the performance is not significantly better than the 
(7,4) code even though the detected but non-correctable 
errors have not been included in the bit error calculation. 
Since the most likely errors in a typical communication 
system is due to single errors if Gray coding is used, the 
performance improvement from the use of double-error- 
detection codes is sometimes not significant. Furthermore, 
the need to implement a repeat request strategy makes the 
(7,3) Hamming code less popular than the (7,4) Hamming code. 
At a BER = 107>, the ¢éoding gain from the (7,4) Hamming code 
is about 4.5 dB which is also the crossover point beyond 


which the uncoded 8-PSK system yields superior performance. 


C. CONVOLUTIONAL CODES 
It is expected that convolutional codes will predominate 
in their application to space and satellite communication 
systems because such codes are relatively easy to implement 
and several attractive decoding schemes for high speed 
decoding exist and are available as "of the shelf" systems. 
The classic Viterbi decoding algorithm is an excellent 
example where the decoder implementation can be accomplished 
using sequential circuits that require only add, compare and 
select operations. In practice, at a bit error probability 
of 107°, a rate one-half code and a Viterbi decoder using 
soft decisions can easily reduce the required signal energy 
per bit by about 5 dB at the cost of bandwidth expansions of 
a factor of two as were be shown in the subsequent sections. 
1. Convolutional encoders 
A very important parameter in the design of a convo- 
lutional encoder which influences the performance of the 
code is the constraint length, L, which is defined as the 
number of encoder outputs that are affected by a single 


input message bit. If the encoder contains k banks of shift 
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registers, not all of which must be of the same length, then 
the encoder memory order, m, is defined as the maximum 
length of all the k banks of shift registers. The constraint 
length is then defined as 


L = n(m+l) 


Poorner important parameter which affects the memory size of 
the decoder is the total encoder memory, K, which is defined 


as 


K = K 
iz 


where Kos is the length of the ith bank of shift registers. 
To enable a fair comparison of the (7,4) Hamming 
code analyzed in the previous section, convolutional codes 
with total encoder memory, K = 4 were chosen in this section 
for analysis and comparisons. The rate one-half and the rate 
two-third codes were chosen as they possess code rates that. 
are close to that of the (7,4) Hamming code. Therefore a 
(2,1,4) code and a (3,2,2) code were analyzed. The criteria 
Ber ecnOOsing che encoder structure is one that maximizes the 
Eree distance dr... of the code. From [Ref 5: p. 330], the 
best (2,1,4) code which gives the maximum eee is obtained 


by utilizing the generating sequences 


gt) = (10011) 
g(4) = (11101) 
famene gives do, = 7. The encoder implementation of this 


code is shown in Figure 4.2. 
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Figure 4.2 Encoder for (2,1,4) convolutional code 


with eee = 7 
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The best (3,2,2) code is generated by the following 


sequences 
apie (1) oa = ( Cela) 
aie =o 0 1) oe oe) 
g(3) =( 100) pe a(t i.) 


and the corresponding encoder implementation is shown in 
Figure 4.3. 
2. Viterbi decoding 

The main advantage of Viterbi decoding algorithm 
lies with the relative ease of hardware implementation with 
which simple operations like add, compare and select are 
performed thus allowing for high speed digital implementa- 
tion. This made it possible to operate at data rates in the 
order of megabit per second. From the development given in 
[Ref 5, pp. 322-328], it is shown that the decoded bit error 


rate using Viterbi decoding is given by 


BeGE) e= (Bae K)( 2s pul=p). Cte? (eqn 4.13) 


where Burree 18 the number of paths with distance equal to 
deree in the encoder state diagram and p is the transitional 
meobability of the BSC. Since deree Of the chosen code is 
known, the problem now involves determining aoe tS 
done by constructing a state diagram for the encoders as 
shown in Figures 4.4 and 4.5. 

For the (2,1,4) code, it can be seen that See = 7 


occurs for only one sequence, S)951S9S4S8g8SQg so that Byrree = 


Poe end Fe(E) from Eqn. 4.13 becomes 
Pp(E) = [2V¥p(i-p) 17 (eqn 4.14) 
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inom eye ecode, it ‘Can be seen that dr... = > 
SGeeurs £Oor Z paths: S958 18480 and Sp8381 259 SO lela 


PL(E) = [2/p(1-p) | (eqn 4.15) 


In order to enable a fair comparison of the 
different schemes considered based on equal transmitted 
Himermatlon rates, the values) of E/N, were reduced by a 
factor of 1/2 and 2/3 respectively for the encoded symbols 
produced by the two encoders. Figure 4.6 shows the decoded 
bit error rate plots of the convolutionally coded data 
transmitted via 16-PSK modulation with Viterbi decoding 
using hard decisions (i.e. the output is quantized into only 
2 levels). In order to improve the code performance, there 


are two possible modifications, namely 


(a) Increase K, the total encoder memory of the code 

(b) Use soft decisions instead of hard decisions, i.e. 
increase the number of quantization levels in the 
output beyond two. 

Heller and Jacobs [Ref. 7] conducted extensive 
computer simulation studies on the performance of codes with 
different encoder memory size, K, and the number of output 
quantization levels, Q. It was found that the coding gain 
(improvement) obtained by increasing K from 4 to 5 was only 
about 0.5 dB. Furthermore, a decoder for a code of memory of 
order K, requires storage (memory) that is proportional to 
2k Therefore arbitrary increases in K without significant 
performance improvements are not practical. [Ref 5: p. 337]. 
Ii. many cases, a value of K = 8 is considered the practical 
Prmat f£0r the Viterbi algorithm. On the other hand 
increasing the output quantization levels from Q = 2 to Q = 


8 requires a much smaller increase in memory size. 
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Figure 4.6 Bit error rates of 16-PSK with 


and without convolutional codes Q = 2 
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The performance improvement however can be shown to provide 
coding gains of about 1.7-2 dB over the range of interest 
for K = 4 and K = 5 codes. These improvements are illus- 
trated in Figure 4.7 which shows that the performance gains 
of the two convolutional codes become comparable with that 
of the Hamming codes considered in the previous section. A 
theoretical proof [Ref. 8] shows that the performance gain 
from using infinitely fine quantization levels in soft deci- 
sion decoding is 2 dB so that the use of 9 = 8 yields 
performance improvements that are very close to the theoret- 
ical coding gain limit. With 9 = 8 and at BER = 107>, the 
coding gain is about 4.5 dB for both convolutional codes 


considered. 
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Ve CONCLUSIONS 


In this thesis, a method to compute the exact bit error 
rate (BER) for the reception of coherent Meary PSK signals 
with Gray code bit mapping and transmitted over an additive 
white Gaussian noise ( AWGN ) channel is described. 
Computation of bit error rates for OPSK, 8-PSK, and 16=-PSK 
modulations were made using the proposed method. The results 
are summarized in Figure 2.8 where it is shown that the bit 
error rate performance deteriorates with higher order M-ary 
modulations. At BER = 107° or less, the performance loss in 
Signal-to-noise ratio (SNR) is about 3.5 dB between QPSK and 
8-PSK and about 4.5 dB between 8-PSK and 16-PSK. Just prior 
to finishing the writing of this thesis, a published paper 
{[Ref. 9] describing a method for the computation of bit 
error rates for Meary PSK signal similar to what was 
described in this thesis was discovered. While the work were 
carried out completely independently, the numerical results 
given in [Ref. 9] and those obtained in this thesis were 
found to be in extremely close agreement. 

Since digital communication techniques are being widely 
used and higher data rates are constantly being demanded, 
demodulators that can efficiently operate at high data rates 
were investigated in the second part of this thesis. The 
demodulator has to be adaptable to digital implementation in 
order to take advantage of the VLSI technology, its struc- 
ture has to be simple and it must allow for parallel bit 
decoding in order to be able to operate at high data rates. 
The demodulator must also provide good BER performance in 
comparison to that of the conventional symbol (followed by 
bit regeneration) detector. Receiver structures for 8-PSK 
and l16-PSK were proposed which have certain very desirable 


features. They allow direct bit detection thus eliminating 
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the intermediate step of symbol detection followed by 
mapping the detected symbol into its representative bits. 
They perform simple arithmetic operation like multiply and 
subtract. Also binary decisions using zero valued thresholds 
rather than M-ary decisions need to be implemented. All 
these along with the parallel decoding of bits provide an 
attractive scheme for digital implementation and allowing 
the receiver to operate at high data rates. 

The receiver structure for 8=-PSK modulation proposed by 
Thompson [Ref. 3] was analyzed in order to determine its bit 
error probability. It was found that at BER = 107°, the 
performance of this detector was about 3.6 dB inferior to 
that obtained using a standard 8=-PSK phase detection 
receiver. Modification were made on the receiver structure 
proposed by Thompson and also extended to the case of 16-PSK 
modulation. The modified receivers have the desirable 
features of requiring only zero valued thresholds which are 
Signal energy independent thus eliminating the need for 
automatic gain control (AGG) circuit Most importantly 
however, the theoretical BER performance of the modified 
receivers is similar to that obtainable with standard phase 
detection receivers. However, all the analytical results 
were carried out on the assumption of the availability of a 
phase and frequency coherent reference signal. This requires 
the use an additional phase locked loop (PLL) circuit in 
order to generate this coherent reference. In a standard 
phase detection receiver, a differential phase encoding 
technique is often used in order to allow for a possible 
phase ambiguity in the coherent reference signal which 
results in only a slight loss in performance. The differen- 
tial encoding technique assumes that the unknown phase error 
of the reference signal remains constant over two symbol 
intervals so that it can be subtracted away. This method, 


however, does not appear to be applicable to direct bit 
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detection methods described in this thesis so that other 
approaches must be used. A possible solution to this problem 
involves allocating a portion of the total transmitted power 
to a residual carrier in order to provide the phase informa- 
tion at the receiver. Modified direct bit detection methods 
that use table look-up techniques appear to be better solu- 
tions to the problem as they are easier to implement and 
make more efficient use of the transmitter power. At the 
moment of writing this thesis, the differential encoding 
method used in conjunction with direct bit detection remains 
an unresolved issue and the author is unaware of any solu- 
tion to this problem cited in the literature. The search for 
a feasible differential encoding scheme that solves this 
problem should be an interesting and worthwhile topic to be 
pursued. 

The third part of this thesis was devoted to analyzing 
_ coding gains obtainable with the use of forward error 
correction techniques used in conjunction with the modula- 
tion techniques described earlier. The methodology developed 
for obtaining BER's (rather than symbol error rates) was 
used in order to determine decoded BER's and true coding 
gains. For the higher order M-ary PSK modulated signals 
(M28), the signal-to-noise ratio tends to be low so that it 
momeorten desirable to improve the BER performance using 
channel coding. The performance of some simple block and 
convolutional codes applied to transmission via 16-PSK modu- 
lated signals were analyzed and compared along with the 
uncoded case. Comparisons were also made with transmission 
using an uncoded 8-PSK modulated signals. It was found that 
at E,/N, = 9 dB, the reduction in BER is- in the order 10 
for coded transmission using a (7,4) Hamming code versus 
uncoded transmission using 16-PSK modulated signals. The BER 
reduction obtained from using uncoded 8-PSK modulation 


versus uncoded 16-PSK modulation was only in the order of 


om 


10. This illustrates the Superiority of channel coding when 
operating under weak signal-to-noise conditions. At a BER = 
107°" the coding gain from using the (7,4) Hamming code on 
16-PSK modulation is about 4.5 dB. The same coding gain at 
BER = 107° can be obtained by using a (3,2,2) or a (2, ie 
convolutional code with Viterbi decoding and soft decisions 
using 8 levels of output quantization, i.e. Q = 8. At low 
Signal-to-noise ratio, the (7,4) Hamming code is capable of 
achieving higher coding gains than comparable convolutional 
codes. This advantage is however offset by the fact that 
block coding schemes are usually more difficult to implement 
in hardware and may require look-up tables or complicated 
decoders cO perform their error correcting tasks. 
Convolutional codes are often easier to implement requiring 
Simple operations like add, compare, and select, which mades 
them particularly suitable for high speed digital implener, 


tation. 
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